Overview:

Microsoft has placed AI at the heart of its strategic vision, and the Azure CoreAI Platform is leading this transformation. This role offers an exciting opportunity to work on cutting-edge technologies like Generative AI, Large Language Models (LLMs), Transformers, GPU optimization, and AI-powered applications.

The CoreAI MaaS & RP team is responsible for building and operating one of the largest-scale engineering systems in the industry for LLMs and GenAI services. The work spans designing, scaling, and expanding inference platforms across flagship services like Azure OpenAI (AOAI) and Model as a Service (MaaS/MAAP).

Key Focus Areas:

• Designing and scaling inference clouds to support flagship AI services.
• Expanding generative AI model offerings, integrating new providers, and creating a unified AI customer experience across Azure AI.
• Delivering highly reliable, performant, and scalable solutions in distributed systems.

Responsibilities:

• Collaborate with stakeholders to gather and refine user requirements.
• Lead architectural discussions and propose solutions through tested design hypotheses.
• Write clean, extensible, and maintainable code while mentoring peers through leading by example.
• Apply debugging tools and log analysis to test, verify, and improve assumptions.
• Take full ownership of critical LLM platform components and deliver end-to-end solutions.
• Integrate customer feedback quickly and effectively.
• Provide operational support for deployed services to ensure reliability and performance.

Key Technical Skills:

Python, PyTorch, Generative AI, Large Language Models (LLMs), Transformers, GPU Optimization, Machine Learning, Distributed Systems, Agile, CI/CD, System Design, Azure (preferred)

Requirements:

• Bachelor’s Degree in Computer Science or related technical field. Equivalent practical experience will also be considered.
• 1–3 years in software engineering with strong coding skills in Python, C#, Java, or JavaScript.

Preferred:

• Hands-on with PyTorch and Generative AI models.
• Knowledge of distributed systems design and scaling.
• Experience in Agile practices and CI/CD pipelines.
• Strong interest in AI, LLMs, and solving complex engineering problems.
• Familiarity with Azure cloud services is a plus.

Other:

• Ability to pass Microsoft’s Cloud Background Check upon hire and every two years thereafter.

This is a role where you’ll grow fast, solve real-world challenges at scale, and directly contribute to Microsoft’s AI growth strategy.